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ABSTRACT 



A new heuristic factorization scheme that uses learning to Improve 
the efficiency of determining the symbolic factorization of multivarlable 
polynomials with Integer coefficients and an arbitrary number of variables 
and tenns is described. The factorization schema makes extensive use of 
Artificial Intelligence teclnlques, e.g. model-building, learning, and 
automatic clMslf ication in an attempt to reduce the amount of searching 
for the irreducible factors of a polynomial. The approach taken to 
polynomial factorization is quite different from previous attempts because 
(1) it is distinct from numerlal techniques, (2) possibilities for terms 
in a factor are generated from the terms in the polynomial, and (3) a 
reclassification technique is used to allow the application of different 
sets of heuristics to a polynomial during factorization attempts on it. 

Tables are presented that demonstrate the liiq)ortance of learning to 
the efficiency of operation of the scheme. Factorization times of 
polynomials factored by both the scheme described in this paper and Wang's 
implementation of Berlekamp's algorithm are given and compared and an 
analysis of variance experiment provides an indication of the significant 
sources of variation influ;jnclng the factorization time. 



I. INTRODUCTIOH 

Before 1967 » attempts to determine the symbolic factorization of multi- 
variable polynomials with an arbitrary number of terms and variables using 
both heuristic methods and algebraic methods proved to be largely unsuccessful. 
These attempts were able to factor only simple polynomials and were time con- 
suming. In 1967 Berlekamp [3] published a new algebraic algorithm for factoring 
univariate polynomials with integer coefficients. Various modifications and 
extensions of Berlekamp* s algorithm [19] » [24] » [26] have led to other algorithms 
for factoring univariate and multivariate polynomials* In particular, Wang^s 
algorithm [24] appears ro be one of the most efficient for both univariate and 
multivariate polynomials. Wang's algorithm factors many multivariate polynomials 
efficiently; however, there are some types of polynomials with which it has problems. 

This paper describes a new heuristic factorization scheme that uses learning 
and other heuristic programming techniques to improve the efficiency of determining 
the symbolic factorization of multivariable polynomials with integer coefficients 
and an arbitrary number of variables and terms. This factorization scheme Is 
applied only to multivariable polynomials. We do not try univariate ones (except 
for a few special cases) since Berlekamp 's algorithm [2] is a clear winner in 
most instances. This factorization scheme makes extensive use of Artificial 
Intelligence techniques, e.g. model*bullding [18], learning, and automatic 
classification in an attenqyt to reduce the amount of searching for all of the 
irreducible factors of a polynomial. The reader should keep in mind that we are 
not claiming that this scheme la a general factorization algorithm for there are 
a few Instances where factorization of a reducible polynomial could fall* However* 
it does succeed in most Instances. Polynomial factorization using heuristic 
techniques is basically a combinatorial problem. Our approach to factorization 



is distinct from numerical techniques, e.g. Kronecker's algorithm [12], and 
advanced algebraic techniques, e.g. Berlekamp's algorithm [2]. 
The primary purposes of this paper are: 

1. to provide an overview of the implementation of the factorization 
scheme in the learning program POLYFACT [5J, 

2. to present the fundamental details of the heuristic factorization 
scheme and discuss its usefulness to polynomial factorization, 

3. to describe Berlekamp's algorithm and indicate where it works well 
and where it has problems, 

4. to show that an Artificial Intelligence approach to factoring 
mult i variable polynomials is feasible for many inultivariable 
polynomials, and 

5. to demonstrate that learning can improve the efficiency ♦ operation 
in the solution of a complex problem such as polynomial 'Ctorization. 

The reader can interpret this paper jointly as one that describes a heuristic 

factorization scheme, and as one that demonstrates the use of learning and 

other Artificial Intelligence techniques in solving complex problems. 

Section II presents an overview of POLYFACT and the implementation of 

this factorization scheme. Section III provides related work in polynomial 

factorization and learning programs. Section IV gives a detailed description 

of the factorization scheme, and Section V presents results and possible 

modifications. 

II. OVERVIEW OF POLYFACT 

This section provides a brief description of the implementation of this 

factorization scheme in the learning program POLYFACT and gives an overview of 

th« scheme itself (a detailed description appears In Section IV). The primary 

objectives in the de^/elopment of POLYFACT ware: 

1. to design a muitivariable polynomial factoring program that can be 
used as a vehicle in a complex-learning environment. 



2. to develop a representation for heuristics that allows for dynamic 
creation and modification during program execution i 

3« to show that learning through the dynamic modification of heuristics 
can be used successfully in a complex environment to increase the 
efficiency of the program^ 

4* CO demonstrate that a classification scheme can be used to allow the 
program to extend itself to newly classified polynomials , and 

5. to show that a classification scheme can be used as a mechansim for 
implementing localized learning* 

Description of PQLYFACT 

POLYFACT is written in FORTRAN V and implemented on a UNIVAC 1108, POLYFACT 
consists of over 2 30 subroutines and functions. Fig, 1 gives a flow diagram 
describing the operation of POLYFACT. Polynomials are Input to POLYFACT in 
FORTRAN notation in either factored form (this form is allowed for convenience) 
or in expanded form. Polynomials input in factored form are expanded by taking 
the product of the factors (the factors may or may not be Irreducible factors). 

Prior to a factorization attempt each polynomial is completely simplified 
(i.e. has all like terms combined) when the polynomial is placed into canonical 
form. In this paper a simplified polynomial is one that has had like terms 
combined. We consider a polynomial to be unslmpllf lable if it has no terms that 
can be combined during polynomial slmplicatlon (there are many reducible polynomials 
whose factors when multiplied out do not have any like terms that can be combined). 
We make the distinction between almpllfled and ttnalmpllf lable polynomials to avoid 
any misinterpretations by the reader that could occur in succeeding sections of 
this paper. 

Representation of Polynomials 

POLYFACT operates m a list processor environment with each cell consisting 
of two consecutive FORTRAN words (each word on the 1108 consists of 36 bits). The 
polynomials in POLYFACT are represented internally as a matrix of coefficients 
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Fig. 1. Macro flow diagram ot POLYFACT 
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and exponents. The matrix Is represented by a list structure with all elements 

in a row linked together as a right-linked list and all elements in a column 

linked together as left-linked list. Each column vector in the canonical form 

corresponds to a term in the polynomial. The list representation of polynomials 

allows POLYFACT to accept polynomials with an arbitrary number of variables 

2 2 

and terms. The internal representation of the p -nomial 3x y+5xz-9y2 is 
given in Fig. 2. 




Fig. 2. Canonical form of 3x2y+5xz-9yz2 



Row one in Fig. 2 contains the coefficients of the terms in the polynomial; 
and rows two through four hold the exponents of variables x, y, and z, 
respectively. The zeros in the left and right links of some of the cells 
are list terminator indicators. We select this canonical form for its 
simplicity of representation, ease of locating specific terms in the poly- 



noai«l» and provision of the requirements of the model-builder. 

Operation of POLYFACT 

POLYFACT operates either in a training mode or learning mode. 
POLYFACT also learns in both modes. While in the training mode» 
the values of H and N and a simplified or unsimpllf iable polynomial 
indicator are Input* The user can train POLYFACT for as long as he deems 
necessary and then change the operation mode to the learning mode. POLYFACT 
can begin operation in the learning mode Instead of training mode, but 
the training mode speeds up the rate of learning because less time is re- 
quired to factor each polynomial. When POLYFACT is in the learning mode, 
no helpful information is given to It. The results of the learning process 
can be saved» and the training cycle omitted in subsequent uses of POLYFACT. 

Overview of the Factorization Scheme 

The factorization sches^ implemented in POLYFACT relies on the fact 
that a reducible polynomial can be written as the product of two factors » 
one with N-terms and one with N-terms. During a factorization attempt the 
M-term factor is sought » and the N-term factor is determined by division of 
the M^term factor into the subject polynomial. Then both factors are saved 
and later reduced. POLYFACT attempts to minimize the amount of searching 
for the M^term factor by: (1) building a model fcr each polynomial, (2) using 
learning for term selection to initiate tne factorization process , and (3) 
using learning to select term possibilities in the M-term : Hctor. 



Classification of Polynomials 

POLYFACT classifies po3 ytiOtaials according to certain features that 
each exhibits (the features are given in Section IV). Through classifi- 
cation the capability exists for applying specific heuristics to a desig- 
nated polynomial. Two types of faatures are used in classification: 
surface features and hidden features. Surface features are those features 
that can be determined by visible examination of the subject polj-nomlal. 
Hidden features are those features not immediately visible to either a 
human or a pattern recognition program. The hidden features are detected 
during a factorization attempt, I.e. during the factorization of a poly- 
nomial characteristics are discovered that are not obvious from the initial 
examination. The detection of hidden features during a factorization attempt 
usually results in a reclassification of the polynomial unless the current 
factorization attempt is successful. The reclassification process is a 
powerful one since it provides the capability to automatically apply different 
sets of heuristics to a single polynomial during its factorization. The 
classification process is closely associated with the ability to dynamically 
create and modify heuristics [6]. 

The features (both surface and hidden) that a polynomial exhibits determine 
the heuristics used during a factorization attempt. In POLYFACT, the classi- 
fication scheme is implemented as a binary classification tree. The classifi- 
cation tree is automatically constructed during program execution. The binary 
features vector of the polynomial is the address of a terminal node in the 
tree. This terminal node contains a pointer to the set of heuristics for this 
particularly classified polynomial. 



The Model** Builder 

A aodel [18] is created for each polynoxalal. The i^del is a means 
fet v^du^i^S amount of searching for a factor in a polynomial. There 
la no learning associated with the model-builder in FOLYFACT. The model- 
builder tries to determine the values of M and N and the valid possibilities 
for terms in the M-term factor (the word "possibility'* is used to denote 
terms that are candidates for terms in the M-term factor). If the factor- 
ization attempt is not successful with the current values of M and N then 
either the polynomial is reclassified and the process repeated with M and N 
unchanged; or the model-builder determines new values fur M and N» and the 
process is repeated. A complete description of the model-^builder is pre- 
sented in Section IV. 

The initial implementation of this factorization scheme in POLYFACT 
requires the explicit determination of the correct values of M and N beforo 
the factorization of a polynomial can be successful* This requirement is 
necessary because: (1) POLYFACT uses a heuristic division algorithm [5] that 
requires the correct values of M and N for a successful division , and (2) the 
determination of the M x N possibility list (discussed in Section IV) re- 
quires these two quantities. In Section V we provide another more operable 
nethod for determining the value of N. This new method frees the model- 
builder from the unenviable task of trying to determine the value of N prior 
to a factorization attempt. This modification also allows the replacement 
of the heuristic division algorithm by a conventional more efficient one. 



Learning in POLY FACT 

The learning schemes depend very heavily on the capability of POLYFACT 
to iMdlfy the heuristics dynamically. The importance of a representation 
for heuristics that allows for dynamic modification is discussed by Clay- 
brook and Nance [6]. The heuristics in POLYFACT are represented in the 
first*order predicate calculus language [16 ] and are interpreted during 
program execution. Interpretation of the heuristics in POLYFACT is necessary 
since they are modified dyni»mically during program execution • 

We have stated that the amount of searching for the M^term factor is 
reduced by using learning to aid in the selection of a term to initiate the 
factorization process and to select term possibilities for the M-term factor. 
The primary objective in term selection is to choose a term that leads to a 
small search space. The heuristic associated with directing learning in 
term selection utilizes the presumption that the term exhibiting the fewest 
number of possibilities leads to the minimum search space* 

The learning associated with term selection is as follows* After a 
successful factorization attempt is complete, the number of pobsibilitles 
In each term of the polynomial is determined. The features of the term(s) 
with minimum number of possibilities have their frequency count (s) increased 
(these features are given In Section XV). Then heuristics are constructed 
dynamically (and ordered) to reflect the importance of the features in 
selecting a term T to initiate the factorization process, i.e. If a feature 
has the highest frequency count, then all terms that do not have this feature 
are removed from consideration for T. The order of the heuristics for term 
selection can vary during program execution since POLYFACT adapts to the 
sequence of input polynomials. Learning associated with term selection can 
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also occur after an unsuccessful factorization attempt since the original 
terms in the polynomial are not changed regardless of a successful or un- 
successful factorization attempt* In fact» the learning associated with 
term selection can be primed prior to any attempts at factorization* 

An example of a term selection heuristic in POLYFACT is the following; 

Hl,l (E T IN Sq) ((N H1(G11(T) ,MINDE0) A N HI (G21(T) ,MINVAR) C FIX123)) $• 
This heuristic with name Hl.l resets the use flag (the use flag indicates 
membership in a set) of each term T in set Sq with degree (degree of T is 
the value of the function Gll(T)) exceeding MINDEG and with number of 
variables (value of function 021 (T)) exceeding IIINVAR. The value of MINDEG 
I9 the degree of the minimum degreed term in Sq, and the value of MINVAR is 
the number of variables in the term with the minimum number of variables in 
Sq. hi is a predicate, and FIX123 is a consequent that is executed if 
the antecedent 

N HI (Gil (T) , MINDEG) A N Hl(G21(T), MlNViVR) 
is satisfied, N, A, and C are the negation, conjunction, and conditional 
symbols, respectively. 

The possibilities that can be selected as terms in the M-term factor 
are ranked according to their apparent merit in determining the correct 
M-term factor, and during a factorization attempt the highest ranked usable 
possibilities are selected* A usable possibilit y is one whose use flag is 
set. The features (given in Section IV) for possibility selection determine 
the rank of each possibility. After a polynomial has been factored, each 
of the terms in the M-term factor is examined to determine its set of 
characteristic features. A binary vector is created with nonzero entries 
Indicating the features present. Then a heuristic is constructed in first- 



order preJlcate calculus notation using as predicates those features 
characterizing the M-term factor* 

To facilitate the construction of this set of heuristics, a matrix 
is inaintained providing a history of the features of tenuS that have 
appeared in factors of previous polynomials* After the vector of ff^atures 
has been created for a term* it is compared with each row in the matrix to 
determine if the vector is already present* If so, the frequency count for 
the matching row is Incremented* If the vector is not in the matrix, it 
is added and the corresponding heuristic is created. 

When these heuristics are used to rank the possibilities in sets Fq 
and ¥i (Fq and Fi are sets of possibilities described in Section IV) , a bi- 
nary vector is created with nonzero entries appearing In the vector petitions 
corresponding to the predicates in the satisfied antecedent* When an ante* 
cedent is satisfied, the vector (created by the satisfied antecedent) is 
compared to each row in the history matrix. If the vector is in the matrix, 
the rank of the possibility is the frequency count, kept as an augmented 
column entry in the matched row; otherwise, the rank is zero. The learning 
associated with possibility selection can also be primed prior to any 
factorization attempts by inputting polynomials in factored form and analyzing 
the terms in the factors or simply by factoring polynomials in the training mode* 

The possibility selection heuristics are maintained in complete predi- 
cate calculus notation and also in the encoded matrix form* The matrix form 
is convenient for determining the need for modifications to the heuristics* 
The term selection heuristics are kept in an encoded form for all classes of 
polynomials and then expanded prior to execution into first-order predicate 
calculus notation* The learning associated with term selection is within 
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classes of polynomials* and learning associated with possibility selection 
carries over from polynomial to polynomial regardless of its classification* 

The type of learning described above is generalized learning [i8]> [20]f 
[21]. In Section V we show that learning is of considerable loiportance in 
improving the efficiency of operation of this factorization scheme* The 
composite of learning and polynomial classification provides a powerful 
mechanism for: (1) implementing localized learning for each class of poly- 
nomials » (2) the automatic extension of heuristics to previously unclassified 
polynomials 9 and (3) the dynamic construction and modification of heuristics. 

Analysis of a Factorization Attempt 

Regardless of failure or success , the results of each factorization 
attempt are analyzed. During this analysis » POLYFACT determines if the 
heuristics for term and possibility selection require modification and 
whether or not the polynomial warrants reclassification in the case of 
failure. If the user desires , learning associated with term and pos* 
slblllty selection can be ended after an appropriate period of time. Then 
heuristics are not modified after a factorization attempt until the learn- 
ing indicator is reset. 

Nature of the Heuristics in POLYFACT 

The creation and modification of all the heuristics in predicate cal- 
culus notation are directed by the learning programs in POLYFACT. The set 
of heuristics determined by the classification scheme for a particular poly- 
nomial guides the actual factorization atteiq>t. Each set of heuristics 
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consists of several subsets, with each subset having a specific function 
to perform. These subsets are responsible for: 

(1) selecting a term T to initiate a factorization attempt, 

(2) creating the set Fq of all possibilities in the term T, 

(3) ranking the possibilities in the set Fq according to their 
probable merit In creating the M-term factor, 

(A) selecting a possibility P from Fq » where P is the first term 
in the M-term factor, 

(5) creating the set of possibilities used to complete the 
M-term factor, 

(6) ranking the possibilities in ¥^ , and 

(7) creating the remainder of the M-term factor (terms 2 through M) 
by the selection of terms from Fj^. 

111. RELATED WORK 

Unlike POLYFACT, most factorization algorithms I21» [121, [19] and 
symbolic and algebraic manipulation systems [8], [9], [14], [15] have been 
in^lemented without any consideration for learning. We try to relate, in 
a succint manner, some of the previous research in polynomial factorization 
and leamlne schempR fn the research described in this paper. 

Factorization Algorithms 

The classical algorithm for polynomial factorization is Kronecker's algorithm 
[12]. This algorithm has been implemented independently by Monove, Bloom, and 
Cngleman [14] in their MATHLAB system, and by Johnson [11]. Jordan, Kaln, and 
Clapp [12] describe a method for finding the symbolic factorization of multi- 
variable polynomials by using a generalized version of Kronecker's algorithm. 
Later references to this work do not establish the implementation of the method. 
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Musser [19] has described algorithms for factoring polynomials with arbitrarily 
large integer coefficients. His algorithms are based on the use of modulo p 
factorizations and constructions based on Hensel^s Lemma [23]. He has 
Implemented algorithms for the univariate case and is currently Implementing 
the algorithms for multivariable polynomials* Wang [24] has an efficient imple- 
mentation of a version of Berlekamp*s algorithm [2] which factors multivariable 
polynomials over the Integers. His algorithm begins by making substitutions 
for all but one of the variables t producing a polynomial in just one variable. 
This univariate polynomial is then factored using Berlekamp's algorithm* After 
this factorization Is done, the multivariable factors are recovered. Berlekamp*s 
factorization algorithm has had such an impact on the factorization of 
polynomials that we outline it below. 

fierlekamp*s Algorithm 

Let f(x) be a univariate squarefree primitive polynomial. All arithmetic 
Is done modulo q (q a prime). We want to determine r irreducible polynomials 
p^(x), 1«1, 2, r such that 

(1) f(x) - p^(x) P2(x)...p^(x). 

If (1) holds and (s^, s^, s^) is any r-tuple of integers modulo q then by 

the Chinese remainder theorem, there is a unique polynomial v(x)p deg v(x) < 
deg f (x) y such that 

(2) v(x) r s^ mod (p^(x)) 1-1, 2, .... r. 

The Chinese remainder theorem applies since the p^(x) are irreducible and therefore 
relatively prime. 
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Information about the pj(x) can be obtained from solutions of (2). Since 
(3) = (mod p^Cx)) 

We find that 

(A) v(x)^ = v(x) mod (p^(x)) i - 1, 2. .... r. 

Using (1) and (4) we get 

(5) v(x)*^ = v(x) mod (f(x)). 

Since 

(6) x^'-x = (x-0) (x-1) ... (x-(q-l)) mod q 
by (3), it follows that 

(7) v(x)*'-v(x) - (v(x)-O) (v(x)-l) ... (v(x)-(q-l)). 

If v(x) satisfies (5) then every irreducible factor of f(x) must divide one 
of the q relatively prime factors of the right-hand side of (7) . Since deg 
f(x) > deg v(x), we have gcd(f(x), v(x)-s) ^ 1 or f(x), i.e. it is a nontrivial 
factor of f(x). In fact 



(8) 



f(x) - n gcd(f(x). v(x)-s). 
0 £ s £ q 



This shows that given any v(x) satisfying (5), we can determine a nontrivial 
factorization of f(x) using gcd»8. Since fast algorithms for finding gcd*s exist 
[4], [8j, the factorization of f(x) is fast when the v(x) is determined. 

There are q^ solutions of (5), and any solution of (5) must satisfy (3). 
Knuth (13 provides a method for finding solutions to (5). We outline briefly 
the steps for finding solutions to (5). Let deg f (x) ■ n; we can construct the 
n X n matrix 



(9) 



Q - 



n-1 
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Vj^x + Vq Is a solution to (5) if «nd only If (vq, Vj^, 
y^l) Q ■ (Vq, v^, .... Vjj_2) (Knuth p.) gives sn slgorlthn for constructing 
Q). After Q has been constructed trlangularlse Q - I» where 1 Is the n x n 
Identity matrix, finding its rank n-r and r linearly Independent vectors v^^\ 

v^^' v^'^^ such that v^^^ (Q - I) - (0, 0, .... 0) for i - 1, 2, .... r. 

At this point, r is the nuniber of Irreducible factors of f(x). 

The solutions to (5) are the polynomials corresponding to the vectors 

tj^v^^' + ... + t^v^^^ for all choices of integers 0 £ t^^, ...» < q. Next 

[21 [2] 
calculate gcd (f(x), v^ '(x) -s) for 0 £ s < q, where v (x) is the polynomial 

represented by vector v^^^ (v^^^ represents the trivial solution to (5)). Then 

12] 

by (8) we have a non-trivial factorization of f(x). If v^ (x) does not succeed in 

splitting f(x) into r factors, further factors can be obtained by calculating 
[kl 

gcd (v' '(x) -s, w(x)) for 0 <^ s < q and all factors w(x) of f(x) found so far, 
for k « 3, 4, ... until r factors are obtained. 

The algorithm outlined above works quite well when q Is small; however, 
if q Is large then (8) becomes a problem area because it becomes impractical 
to compute the gcd of f(x) and v(x) -s for each s e GF(q). Berlekamp*s algorithm 
also suffers a loss in efficiency when the degree of the polynomial Is large. 

Berlekamps [2] discusses a method for dealing with (8) when q is large. 
This method was originally proposed by Zassenhaus [26]. The Zassenhaus algorithm 
transforms the problem of factoring f(x) over GFCq"') into the problem of finding 
the roots of a polynomial over GF(q). We outline Zassenhaus' approach for 
factoring polynomials f(x) over Z (rational integers) below. 
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Zassenhaus Algorithm 

In general it is more difficult to factor a monic polynomial f (x) of degree 

n over Z« If C Is the maximal absolute value attained by the coefficients 

of f(x), the coefficients of a factor g(x) »x -f-bx . . ^ ^ b satisfy tlu^ 

1 m 

inequalities |bj| <^ (^) (C ^ 1)^ (j * 1, 2. . . . , m) [27] • If these bounds arc r.nt 
too large for ™ > the factorization of f(x) over Z can be accomplishiid 

by picking a prime q which is greater than the maximal bound and by then 
factoring f(x) over GF(q). Zassenhaus used Hensel*s Lemma [231 to develop an 
efficient means for factoring polynomial f (x) over Z* He choses any primo q 
not dividing the discriminate [13] d(f) and decomposes f (x) into two munie fat i»)r,s 
modulo qZ[x]. f(x) is irreducible over Z if it has no proper decomposition 
modulo qZ[x]* Othi tviae, the decomposition modulo qZ[x] is raised to a modulus 
which involves a higher power of q, proceeding from 

f(x) H f^(x) f^Cx) mod (q'^Ztx]) to 

f(x) £ f^(x) f'(x) mod (q^^Z[x]). 

Eventually 9 it will be possible for a suitable power of q to decide whriiH r ur 
not the decomposition of f(x) modulo q^Z[x] gives rise to a dccomposi i i« ot 
f(x) over Z. The power of q in the modulus will quickly approach the al>ovc> 
mentioned coefficient bounds. This procedure has to be carried on recurs Ivolv 
for each of the two factors of f(x) over Z that results from the first sf«*p. 
Finally f(x) is decomposed into a product of irreducible factors over I. TIic 
weakneBS of this approach occurs when f(x) has many more factors modulo qZfx| 
§~ for the prime q chosen than It has over Z itself. 

The Berlekamp^Hensel algorithm (e.g. Wang*s algorithm) does particularly 
poorly in one case: the ^^bad zero** case. This case occurs when a feubstl tai i* i; 
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of zero for all but one of the variables causes the leading coefficient to go 
to zero. The heuristic algorithm described in this paper has few problems with 
this type of polynomial. More will be said about this In Section V* 

Cost of Factorization in Berlekamp-type Algorithms 

Musser [19] has shown that Berlekamp*s 1967 algorithm [3] is dominated by 

3 2 2 ^2 2 
n L(q) ^ n L(q) + n rqL(q) , The L operator is defined as the number of 

digits in q (L(q) can also be interpreted as log (q)). In the multivariate 

case it is Hensel*s Lemma [23] that dominates in computing costs* not Berlekamp*s 

algorithm. Musser has shown that the time for application of Hensel's algorithm, 

2 3 2 , 

to univariate polynomials, is dominated by n L(m) + nL(m) L(c), where 

n » deg f(x), m > 2B (B is a bound on the coefficients of the divisors of f(x)), 

and c « |f(x)!^ (|f(x)|^ is the sum of the moduli of the numerical coefficients 

of f(x)). Comments on the cost of the factorization scheme described in this 

paper appear m Section V« 



Learning Programs 

In many cases learning has been studied in a simple environment [17], 
120], [22] so that more attention can be paid to learning schemes than to 
the problem environment. We limit the discussion of learning here to a 
few generalizeB learning [21] schemes. Generalized learning has been used 
»ore frequently by researchers In Artificial Intelligence than any other 
learning technique. Tne reason for their frequent use seems to be twofold: 
(1) humans tend to use generalized learning In their learning habits, and (2) 
other learning schemes, e.g. rote learning [21] and concept learning [10] are 
applicable only in certain luatances. 
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Generalized learning has usually appeared in the form of modifying weights 
in an evaluation function^ e.g. in Samuel^s checker program [21] » Michie and 
Ro8S*s Graph Traverser [17], and Slagle and Farrell's MULTIPLE program [22 J* 
Waterman [25] has presented some generalized learning techniques in his 
poker playing program. His program generalizes by modifying heuristics » 
represented in production form^ to catch state vectors that represent 
game situations. 

This discussion of learning programs is brief; the reason being that 
very little use has been made of learning in solving practical problems. 
We hope this paper will convince the reader of the importance of learning 
as a problem solving tool. 



IV. DETAILS OF THE FACTORIZATION SCHEME 

In Section II the reader was introduced to the basic ideas behind this 
factorization scheme. In this section a detailed description of the scheme 
is given. Before describing the factorization scheme « we point out that not 
only is learning Itself used to reduce the amount of searching for the factors 
of a polynomial, but other heuristics are employed as well, e.g. creation of 
the M X N possibility list and Its use in creating the set Fq, the g.c.d. 
constraint, etc. The reader should be able to pick out these heuristics in 
this section. 



Responsibilities of the Model-^Builder 



The model-builder is the most important part of this factorization scheme. 
In addition to determining the values of M and N (M<N) , the model-builder also: 
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(1) creates the M x N possibility list (this list contains all the possibilities 
that can be tried as terms in the M^term factors) | decides if the 
polynomial is simplified ^ and (3) determines whether or not the polynomial 
la irreducible. 

If a polynomial can be factored into an M x N factorization, then the 
terms in the M-term factor must be in the M x N possibility list created by 
the model-builder« If a polynomial is reducible and has a term in the 
smallest factor (the M-term factor) that is not in the possibility list, 
then the polynomial cannot be factored into an M x N factorization^ i*e* 
the values of M and/or N are incorrect. 

Calculation of M and N 

The values M and N are the two most important quantities determined by 
the model-builder. They are the basis for determining the possibility list 
mentioned above* Few features of a polynomial give any Insight as to their 
values. The approach to determining M and N In the initial implementation of 
POLYFACT is the following (another more operable approach is described in 
Section V): 

1. Try to detect whether or not the polynomial is a simplified poly- 
nomial. 

2. If it is not possible to determine that the polynomial is a simplified 
polynomial then assume that it is an unsimplif iable polynomial. 

3. Using NTERMSi the nuniber of terms in the polynomial, d&termine all 
possible combinations of M and N such that M<N and N*NTEKMS/M (M 
must divide NTERMS). ^ 

4« Try all possible values of M and N as determined by 3 above until 
factorization is successful, or the pairs of values are exhausted. 

5. If factorization has failed as outlined in 4, then assume that the 
polynomial is a sltiyllf led polynomial. 
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6. Once POLYFACT has assumed that the polynomial is a simplified 
polynomial, It uses some more surface features to determine how 
the terms were added out or combined. 

7. If the coefficients arc. all unity, then terms arc ndded out in pair^^. 

8. If some or all of t\\o coefficients are sreatcr rii.ir. unity , then soirr 
of the terms can bo added out In pairs or may sinply he combined int^i 
one term. 

9. Using 7 and 8, POI.YFACT decides whether to incrrncnt NTERMS by 1 
or 2 and then proceeds as in 3 and 4, respec t i 1 \ . 

Each Lime the value of M and/or N changes, a new M x N po^^sihility list is ctv.\:*'a. 

The sticcess or failure of d*»tennlnlnR the f actori r,.ir ion of a pnlvnonn .l 

drp**nds on the ability to determine the correct values for M and N. The 

do termination of M and N depends on how many terms were in the polynomial 

prior to bolnj; placed In canonical form* Some tvpes of polynomials^ e*f;. 

repeated factor, differenco of powers, or single varlabJi* polynomials^ 

usually have a large number of the terms combined duri.u* sixpl if icatitm. 

Howovt^r, in many instances these three typrs ot polvnnni.ils can be r.Iassitii vl 

as special ones and the appropriate hruristics applitd. If a polynomial 

cannot be classified as a special polynomial or an artompti^d factorization 

of it as a special polynomial fails» then factorization proceeds in the 

normal manner outlined in this paper. Repeated factor and difference of pow« r 

polynomials are the only special case polynomials considered by tills ti»chn iquf- 

In some instances substitution is necessary to place th*' polynomial in a fnnn 

recocnlzahle as a special polynomials Polynomials 10 and 12 In Appendix A 

are 4'xamplcs of repeated factor polynomials. Polvnomial 1,J Ls a dlfferi»nr<- 

of power polynomial. 
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The M X N Possibility List 



As we stated previously, the M x N possibility list is the list of 
valid possibilities that can be tried as terms in the M-term factor. All 
possibilities appear in this list with implicitly defined unit coefficients. 
This consideration saves considerable memory in storing the possibility ILst 
and is a valid approach because POLYFACT has not yet created the and 
sets. These sets are much smaller than the H x N possibility list, and 
the possibilities in them are the only ones that require the coefficients 
to be determined. This discussion becomes much clearer when we discuss 
the creation of the and F^^ sets. 

We point out now that one reason the raodel-builder tries to specify 
the correct values cf M and N is that the size of the M x N possibility 
list decreases as N increases. Thus, in most instances the size of the 
M X N possibility list decreases during a sequence of factorization attempts 
on a polynomial, thereby decreasing the search space for the terms in the 
M-term factor. The suggested modification to the determination of N in 
Section V removes, to a certain extent, this advantage; but it aimplifles 
the model-builder's tasks considerably. 

The procedure for determining the M x N possibility list is described 
below. The first possibilities to be placed in the possibility list are the 
single variable possibilities. For each variable x in the polynomial a 
sequence of quantities t ^ is calculated. The quantity t^ la the number 
of terms in the polynomial in which (l<^i<maxdeg(x)) appears as a factor. 
The quantity 1 ^-(t ^-K'N)/(M-K) , 1 <^ K < M, where K is the nuaber of terms in 
the M-term factor in which x^ can appear. Is calculated for each x^. If 
1 ^>0, then is a valid posalbillty. An interpretation of 1^ is that 



It is the number of terms In the N-tenn factor in which x appears as a 

factor. After all single variable possibilities have been detenu '.ned and 

entered into the M x N possibility llst» the multlvariable possibilities » 

I.e. possibilities that contain more than one variable, are determined. 

The ahove procedure for determining single variable possibilities is 

generalized to multlvariable possibilities. The prospective multlvariable 

possibilities are determined by forming products , in a systematic manner* of 

the single variable possibilities already in the M x N list. Every such product 

of single variable possibilities is not neessarily a valid possibility^ i.e. 

if x^^ where x^ is now a multlvariable quantity, does not satisfy the 

requirement that l^^^^Of then it is not included in the M x N possibility list. 

When a possibility is added to the possibility list, the quantities 

t ^, 1 ^, K, and an indicator as to whether it is a single variable or 
x x 

multlvariable possibility become a part of the possibility entry. Some of 
these quantities are used later in ranking possibilities. 

The Factorization Process 

The reader may want to refer back to Fig. 1 as he begins reading this 
section. The material discussed here is associated with subroutine FACTOR 
in Fig. 1, and the heuristics used during a factorization attempt. Fig. 3 
describes the operation of FACTOR during a factorization attempt. 

The set of heuristics determined by traversing the classification tree 
guides the actual factorization of a polynomial* The features used in 
POLYFACT to classify polynomials are the following: 

1. Coefficients are units. 

2. The polynomial is a simplified polynomial (versus an una impll flab le 
one). 
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3. Set is empty, 

4. The number of possibilities in set F is less than (M-1) but greater 
than zero, ^ 

5. Single variable polynomial • 

6. Difference of powers polynomial. 
?• Repeated factors polynomial « 

Features 2^ 3, and 4 are hidden features. 

Initially^ all terms in the polynomial are members of the set S^, Each 
term in is a candidate for the term selected to initiate a factorization 
attempt. The following features of terms are used to induce learning for 
term selection as described in Section II: 

1. Degree of the term. 

2. Number of variables in the term. 

3. Size of the coefficient, 

4. Is the coefficient prime? 

The term T is selected from the terms remaining in after the term selection 

heuristics are applied. Another set S^ is created that consists of all terms 

in the polynomial with the exception of T. The terms in S^ are those avalrible 

for creating the set F . 

1 

The set F^ is created next as indicated in Fig. 3. F^ consists of all the 
valid possibilities in T. F^ contains those factors of T that are in the 
M X N possibility list. In the process of creating F^^ the coefficient of T 
is used to include in F^ not only possibilities with unit coefficients; but 
all other valid possibilities (that are factors of T) with coefficients 
dividing the coefficient of T. Note that we have to Include in Fq only 
possibilities with positive coefficients. 



-"-T is used to indicate the term selected to initiate a factorization attempt. 
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The possibilities in F are ranked according to their merit (the ranking 

0 

process is described in Section II). The features used to rank the possibilities 

are the following: 

1. Is the possibility a single variable possibility? 

i , „ 

2. Does the possibility have a low t value? 

3. Does the possibility have a high t ^ value? 

4. Are all the coefficients in the polynomial units? 

5. Is the coefficient of the possibility a unit? 

6. Is the term T a multivariable term? 

The highest ranked usable possibility P in Fq is selected as a candidate 
for the first tarm in the M-term factor and flagged so that it cannot be 
selected again. A second set of possibilities F^ is created using P. The 
set ?^ consists of all those possibilities TP determined by TP=T'/TF where: 
(1) T' is any term in S^^. (2) TF-T/P, and (3) TP is a valid possibility. 
For a possibility to be considered a candidate for a valid possibility for 
Fq and F^^, its variable part must be contained in the M x N possibility list. 
The set F^ contains all those possibilities that are candidates for terms two 
through M in the M-term factor. The possibilities in F^^ are ranKed using the 
same heuristics used to rank the possibiftties in F^. 

An M-term factor is formed by selecting the highest ranked usable term 
from Fq and the rest of the terms from F^^. If the greatest common divisor 
of the terms in this newly formed M-term factor is not one, then another M-term 
factor is formed. When the greatest common divisor constraint is satisfied, 
the M-term factor Is divided Into the subject polynomial. If the division 
is successful, the quotient is the N-term factor; otherwise, another combination 
of possibilities is selected to create another M-term factor, and the process 
is repeated. The greatest common divisor constraint is imposed to reduce the 
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number of possible factors that can be generated for the M-term factor. The 
use of this constraint is justified because any monomial factor is removed 
from the polynomial before the M-term factor is sought. 

If all of the possibilities in have been selected without a successful 
factorization attempt and there are no more terms in Sq (S^ after the term 
selection heuristics are applied), then the model-builder decides the fate 
of the polynomial. If a factorization attempt is successful, both factors 
are saved and processed. 

Because a record is maintained of all combinations of possibilities tried 
for a given factorization attempt, the construction of a previously formed 
factor is avoided. In POLYFACT, a possibility search tree (depth-first) 
is used to record each combination of possibilities as it is tried. When 
a new factor is formed, the tree is searched to determine if it has previously 
been used. This tree can be used later in the analysis of a factorization 
attempt. 

Ths irreducibility of a polynomial is determined by the model-builder. 
This is the most difficult problem associated with polynomial factorization. 
The author has found no surface features of polynomials that give a hint to 
the solution of the problem. For unsimplif iable polynomials, the scheme 
described in this paper can easily determine whether or not a polynomial 
is irreducible by simply trying all valid M x N factorizations with M <^ N, 
A simplified polynomial is considered irreducible by POLYFACT when the M x N 
possibility list has less than M possibilities in it. The M k N possibility 
list decreases In size as M and/or N increase In size. We suspect that new 
features discovered to improve the detection of irreducibility will be hidden 
features. Note that we mentioned earlier that a few reducible polynomials can 
fall to be factored by POLYFACT (these are described later in this section); 
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hence, POLYFACT v;ill consider these to be irreducible polynomials. This is 
a deficiency that Wang's algorithm can handle since his algorithm does not 
terminate until it has proven that It has found all irreducible factors. 



A Very Simple Example 



We demonstrate the factorization process by factoring the following 

simple polynomial (this polynomial happens to be unsl m plif iabl e) ; 

32244^32 3^5 22 32 
X y -X y -X z+x y z*xy z+y z+x yz -xy z . 

We choose this simple polynomial to keep the M x N possibility list and the 

F\ and F sets small. 
0 1 

The above polynomial has no monimial factor. The model^builder determines 

the initial values for M and N (M*2 and N=4) and the possibility list: 

2 2 2 2 2 

{x, X , y, y , 2, xy» x y, xy , xz, yz> y z}. The features vector for the 

polynomial is the ordered set { 1 ,0 ,0 ,0 ,0 »0»0} . The only feature that 

POLYFACT detects on the initial classification of this polynomial is that 

the coefficients are units; hence, component one in the features vector is set. 

Initially » contains all eight terms in the polynomial* Next suppose 

4 

the term selection heuristics determine that the term -x z is T. Set S^^ 

,322432 3522 3 2,^, 
now consists of {x y ,-x y tX y z,-xy z,y z,x yz ,-xy z }. The set of 

2 

possibilities in T» F^» is {x»x |Z»xz}. Suppose that x has the highest rank 
among the four possibilities in Fq. The set i.e. the set of possibilities 

determined by calculating TF«T'/TF, where T' is any term in and 

4 3 2 2 

TF«T/P«-x z/x»-x contains only -y since y is the only poaslblllty TP in 

the 2x4 pof?sibility list (the coefficient of TP is ignored when determining 

whether it is in the possibility list). 
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In many instances a sufficient number of terms for creating this factor are 

present in t!ie polynomial and no Lernis liavc: Lo he added. Wlienever terms must 

be added to the polynomial to create the corrtict M-term factor for successful 

factorization, POLYFACT adds them* in pairs. POLYFACT adds terms only when 

the size of set F^ is less than (M-1). Added terms are placed in S^^ and 

the corresponding possibilities are placed in F^» The new terms in S^^ have 

their use flags turned off until the corresponding possibility in F^^ is chosen 

as a term in the M-term factor. The new possibilities in F^ are assigned rank 

zero so that those already in F are selected first. 

1 

If the size of F^ is less than (M-1) but not zeto, POLYFACT assumes 
those possibilities already in are correct and necessary for construction 
of the M-term factor. The new possibilities in F^^ are selected in serial 
order to determine efficiently all the possible combinations that can be 
used to create the M-term factors. If the size of F^ is zero, then all 
possible combinations of the new possibilities are tried until success or 
failure occurs. In this case POLYFACT forms all possible combinations 
of the possibilities in F^ in normal fashion > i.e. the possibilities are 
ranked^ and the highest ranked ones are selected first. 

The terms missing in polynomials that have unit coefficients are added 
in by selecting possibilities from the M x N possibility list and forming 
the product with TF (TF is described above and is the fii^st term In the 
N-term factor). The terms missing in polynomials with coefficients larger 
than one arc determined by dividing TF into every term in the polynomial 
not associated with a possibility already in Fq and F^» I.e. the usable 
terms in . If the quotient (ignoring coefficients) F«TVTF is a possibility 
in the M X N possibility list, then the term Tq=f*TF is a candidate for a 
nisslng term; however, the coefficient of F, and hence T^, may be Incorrect. 
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In general, is not the same as T* ; iu ^t v ir, the variable part of each terra 

is identical. The coef iici eni j of F and I art- reconstructed by POLYFACT, 

0 

POLYFACT initializes the coefficient of t tv^ zero. Wlien F is selected from 

F^ as a possibility for the M-term factor. iLs cof^fficient is incremented 

until it divides at least tw ) usable tern^^ in S^. l^ien the coefficient of 

this possibility becomes so large that tht^ ; /.ssibility has no chance of 

dividing at least two usable terms in S , ii nas its coefficient reset to 

1 

zero and another possibility is selected ir. , 

X 

Whenever POLYFACT selects a new poss I bi 1 i tv from F that is associated 

1 

with an added term, the use flags of tlie rrei^ponding pair of new terms in 

are set. Then POLYFACT checks the usable terms in S to determine which 
1 1 

uf these terms can be combined with a new Lerni. POLYFACT uses this technique 
to reconstruct the polynomial as it exlsL^:d before simplification occurred. 



V, RESULT S 

This section provides some of the results of factoring over 300 polynomials 
using POLYFACT. Most of the 300 plus polyncruials factored by POLYFACT are 
random polynomials with number of term» (af tt r being placed in canonical form) 
{2»84], number of variables [2,5], degree of each variable [0,12], and 
coefficients [-10000,10000]. The random polynomials are generated by generating 
factors randomly, multiplying them together, and then simplifying the expanded 
form* The random factors are developed by generating terms randomly by selecting 
the number of variables* degree of each variable, and coefficient from the 
range of values for each given above. Appendix A contains a subset of these 
polynomials. Space (the 300 plus polynomial > la factored form occupy 20 
typed pages) does not allow us to include in Appendix A all of the polynomials 
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factored by POLYFACT during this research: Ju relort^, in si^me instances we 
provide tables to Illustrate liuportant rf,'-'::* - wii!i:;t j^ivMij*. all the polyuamials 
associated with them, e.g. Table I. Tabliv. ! - IV JemoiisLraLt- the Importance 
of learning to the efficiency of operation VolYVACW An analysis of 
variance experiment is also described^ aiui l*u* sources located that tend to 
influence the factorization times. 

Results Associated with Learning 

These results were obtained to demonstrate that the capabilities of 
POLYFACT are increased through learning . S<- vt ral approaclies could be taken 
to assess the influence of learning on program performance or program efficiency. 
By efficiency we mean efficiency with respect to execution time and memory 
used. An obvious way to measure program efficiency through learning In 
POLYFACT is to factor several polynomials with and without the use of learning 
and then measure the size of the possibility i^carch tree (Section II) in 
each case. With this^proach program efficiency is measured by comparing 
the size of the possibility search tree created using learning with that 
created without learning. This is characteristic of past approaches to 
evaluating learning [17]. While the above approach is valid for evaluating 
some programs > we do not believe that is is iiatisf actory for POLYFACT since 
it is only a gross measure of learning. Instead, we choose an approach that 
illustrates explicitly the effectiveness of POLYFACT in selecting both terms 
and possibilities* 

Term Selection Rvsults 
The term selection tests consist of factoring several sequences of 
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randomly generated polynomials and determining for each polynomial: (1) the 
minimum number of possibilities in a term, (2) the maximum number of possibilities 
In a term, and (3) the number of possibilities in the term selected* We 
consider that FOLYFACT selects **good'* terms when It selects terms with a minimum 
number of possibilities « The term selection tests are also used to determine 
whether or not POLYFACT can adjust the order of the term selection heuristics 
for randomly generated polynomials with different ranges of values for size 
of coef flclents^ degree of variables, etc. 

Table I contains the results of selecting terms for one sequence of 
random polynomials. The random polynomials for this sequence have the charac- 
teristics: coefficients [-64, [-400,400], [-2500,2500], degree of 
variables [0«8], [0»12], [0,12], and number of variables [2»4], [2,5], [2,5], 
respectively* The first six polynomials in this sequence are the training 
sequence. To conserve space, the random polynomials In this sequence are 
not Included In Appendix A. 

A summary of the results of the term selection testa is as follows: 

1. The term selected to initiate factorization in 73 percent of the 
polynomials has the minimum nusdber of poeslbllltles (the percentage 
for the sequence in Table I, disregarding the training sequence, la 
about 67 percent) • 

2« POLYFACT orders the term selection heuristics depending on the 

characteristics of the polynomials (the order depends on the range 
of values f>r number of variables, degree of variables, etc.) 

3. Term selection does Increase the efficiency of POLYFACT considerably 
by allowing, in most cases, for as small a search space as possible* 

For the sequence of polynomials in Table I, the number of variables is the 

wont important feature for selecting a term with minimum number of possibilities 

with the degree of term and the size of coefficient of almost equal importance. 

Another sequence of polynomials could cause POLYFACT to order the term selection 



TERM SELECTION 



TABLE 1 ^ QQpY hmum 

FOR RANDOM POLYNOMIALS 





Minimum 


Maximum 


Number of 




Number of 


Number of 


Possibilities 




Possibilities 


Possibilities 


In Term 


Polynomial 


In A Term 


In A Term 


Selected 


3 


11 


36 


20 


2 


20 


47 


30 


17 


5 


24 


6 


2 


20 


47 


25 


18 


7 


14 


7 


19 


4 


13 


4 


99 


2 


115 


2 


112 


84 


921 


104 


100 


36 


1139 


36 


135 


25 


160 


25 


179 


14 


38 


14 


180 


2 


201 


2 


181 


14 


1014 


14 


182 


19 


166 


19 


183 


11 


54 


24 


184 


12 


75 


14 


185 


4 


53 


4 


186 


51 


305 


54 


187 


12 


174 


12 


70 


8 


26 


8 


188 


30 


459 


30 


189 


75 


468 


91 


190 


15 


190 


15 


191 


5 


304 


5 


192 


20 


204 


30 


193 


23 


230 


25 


194 


17 




1 7 


195 


18 


130 


18 


196 


21 


149 


21 


197 


6 


379 


6 


198 


17 


631 


34 


199 


12 


146 


12 


200 


27 


1140 


42 


201 


6 


241 


12 


202 


32 


489 


32 


203 


24 


398 


24 


204 


30 


645 


30 



36 

BEST COPY AVAHABU 

heuristics differently. Learning allows POLYFACT to adjust the order of 
heuristics so that a term with the minimum number of possibilities is found 
In most cases. The selection of a term is very important because the analysis 
of variance results show that the number of possibilities in a term is one of 
the two main contributors to the factorization time for a polynomial. 

Possibility Selection Results 

We associate a value that we term efficiency with possibility selection. 
The efficiency value is an assessment of the capability of POLYFACT to learn 
to rank the possibilities. Before we defiit efficiency the following four 
definitions are needed: 

The possibility search space is the set of possibilities in the 
M X N possibility list. 

The actual nowsihlltty search space is the set of possibilities 
generated by the term selected to initiate the factorization 
process. 

Let r,, r-, r- be the n(n>l) values for the ranks of the 

possibilities in the actual search space, and suppose the 
possibility selected from Fq that leads to a successful factoriza- 
tion has rank r^(l<^l<n). Then the reduced posalbilitv search space 
consists of all those possibilities with rank equal to or exceeding r^. 

The size of a possibility search space is the number of possibilities 
in the search space and is denoted by || possibility search space ||. 

The efficiency with respect to possibility selection is defined as: 

Efficiency - II actual search space II - II reduced search space || 

II actual search space || 

The efficiency values shown in Table II are given as a ratio to explicitly 

•how the size of the actual search space (denoainator) and the number of 

possibilities *.n the actual search space that are not meinbers of the reduced 

search space (numerator). The efficiency value in decimal form allows the 

reader to ascertain that efficiency increases with experience. All 
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possiblllcies with the same rank have an equally likely chance of being 
selected as a term in a factor. 

The possibility selection tests consist of factoring different sequences 
of randomly generated polynomials and determining the efficiency values 
for each polynomial. The polynomials in Tables II - V are in Appendix A. 
We show that POLYFACT learns to select the "good" possibilities by demonstrating 
that the efficiency values tend to increase for successive factorizations of 
randomly generated polynojaials. An asterisk (*) to the right oi the efficiency 
values in Table II Indicates that only the highest ranked possibilities are 
in the reduced possibility search space. 

Table II is one of three tables used in Claybrook [5] to gather the 
following results: 

1. The size of the actual search space is decreased usually by 50 to 
80 percent through learning. 

2. As POLYFACT gains in experience it becomes more discriminant in 
the ranking of possibilities, i.e. some polynomials have several 
different ranks for the possibilities in their actual search spaces. 

3. In most cases the reduced search space consists of only the highest 
ranked possibilities. 

Result (2) and Table II show this factorization scheme could be inplamcnted 

to consider a factorization attempt to fail when all of the highest ranked 

possibilities in Fq have been used as the first term in the M-term factor, 

i.e. the possibilities with ranks lower than the highest rank are never 

considered. Then usually only 20 to 50 percent of the possibilities in 

Fq would even be considered, fiut this consideration may cause a few 

reducible polynomials, e.g. polynomial 39 in Table II, to not be factored 

because a lower ranked possiblli'ty in F^ led to a successful factorization. 

This idea requires that a proper training sequence of polynomials be input 

to prime the learning associated with possibility selection. 
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TABLE II 



EFFICIENCY VALUES 



BEST COI^ AVAIIABLE 



SEQUENCE #1 


SEQUENCE #2 


Polynomial 


Efficiency 


Polynomial 


Efficiency 




^J\• yJSJ/ 














21 




45 


l/2( 50)* 

Xf M V * / 






46 


0/18/ ooS 


2^ 


17^ 


47 


0/46^. OoS 


2A 




HQ 




2^ 


^/ V • / J/ 


49 

H^ 


17/36f 47S 


2A 
^o 


W/ XH V • ^-J/ 




1/12^ 08)* 

X/ X6 y f vv/ 


97 


j/ XH V • J 


JX 


lO/LK 21) 

Xli/ H / V • 4X/ 


2R 
zo 




52 


60/lOOf 60)* 


2Q 


XX/ Xv V • 




62)* 




^ /I 7 9Q^ 


JH 


J/ XX V • 4 « / 


31 


4/15(.27)* 


55 


17/25(.68)* 


32 


5/ll(.45)* 


56 


71/99(.71)* 


33 


22/28(.79)* 


57 


34/45(.76)* 


34 


13/22(.59)* 


58 


81/100(.81)* 


35 


30/49(.61)* 


59 


5/7(.71)* 


36 


23/53(.43) 


60 


25/33(.75)* 


37 


3/6(.50)* 


61 


47/69(.68)* 


38 


6/10(.60)* 


62 


9/10(.90)* 


39 


4/8(.50) 






40 


44/56(.79)* 






41 


7/19(.37)* 






42 


5/6(.83)* 






43 


21/24(.87)* 






44 


50/60(.83)* 







Recurrent Factorization Results 

Another test that further demonstrates fOLYFACT's learning and factorl- 
Mtlon capabilities Is the recurrent factorization test. This test consists 
of factoring several sequences of polynomials, generated by the author, 
that have the same polynomial appearing more than once in a single sequence. 
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We nalntaln that learning occurs in POLYFACT when the factorization times 
dacrease for subsequent factorizations of the same polynomial. The purpose 
of Tables III and IV is to show that POLYFACT learns from previous experience. 
Tabl.-s III and IV show that POLYFACT usually factors the second and third 
occurrence of the same polynomial In a single sequence in less time than for 
the initial factoring. 

An analysis of Tables III and IV is summarized briefly; 

1. the order of the polynomials in the sequences influence the 
factorization times, e.g. polynomials 2 and 9 In sequences 
3 and 4, 

2. after two or more factorizations of the same polynomial in a 
given sequence, further reduction in the factorization time is 
usually quite small, 

3. POLYFACT is capable of factoring difficult polynomials, e.g. 
polynomials 6 and 8, and 

A. subsequent factorizations of the same polynomial Indicate the 
reduction In factorization time is markedly significant (on 
the order of 100 to 300 per cent). 



Some Comparisons with Wang's Algorithm 

We stated previously that Wang's algorithm [24] for polynomial factorization 
is an implementation of fier lekaiq) * s algorithm w ch some variations. The Wang 
algorithm is Implemented in LISP l.S on a PDF-. i at M.I.T. as part of the 
MACSYMA system [15]. We do not compare the algorithms themselves because they 
ara aignificantly different approaches to polynomial factorization; and hence, 
there are few areas for comparison. However, we provide factorization results 
of some multivarlable polynomials factored by POLYFACT and Wang's algorithm, 
taibla V shows the factorisation tines for these polynomials. 
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RECURRENT FACTORIZATIONS 



SEQUENCE #1 


SEQUENCE #2 






Prt 1 vnOfni A 1_ 

t Kf ^ y IftwMAXO X 


FActorlzAtion Time 








1 


2.48 


3 


2. 32 


2 


16.36 


7 


16.34 


8 


864.72 


7 


11.88 


6 


781.26 


7 


11.88 


2 


8.02 


9 


222.74 


8 


208.34 


9 


221.74 


6 


331.20 


9 


174.66 


2 


7.94 


4 


53.94 


8 


208.00 


4 


29.12 


6 


380.08 


4 


28.00 






5 


14.22 






5 


4.48 






5 


4.48 



TABLE IV 



RECURRENT FACTORIZATIONS 







SEQUENCE //3 


SEQUENCE //4 


Polynomial 


Factorization Time 
(seconds) 


Polynomial 


Factorization Time 
(seconds) 


3 


2.32 


3 


2.32 


63 


169.44 


2 


12.50 


9 


554.84 


64 


112.52 


63 


95.16 


65 


9.94 


9 


174.62 


2 


11.14 


63 


95.16 


64 


102.82 


9 


174.34 


65 


11.86 


64 


180.64 


2 


6.86 


2 


24.28 


64 


49.42 


16 


17.14 


65 


11.86 


64 


126.30 


5 


16.98 


2 


19.96 


7 


32.16 


16 


10.06 


9 


222.68 


64 


50.02 


5 


15.62 


2 


14.08 


7 


24.72 


16 


10.06 


9 


221.46 




5 


11.68 






7 


24.72 






9 


174.62 
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TABLE V 



CUMT^VRISON OF KUZTOiUZAllON Il^-U'S (LV SECONDSf g£5J QQpY Atf/tfLABlf' 



Polynomial 



POLY FACT 
(with learning) 



9 
12 
16 
67 
68 
69 
70 
71 
72 
73 



174.66 
6.85 
10.06 
149 . 26 
160.03 
172.16 
1.97 
25.38 
67.49 
129.01 



Wang's Algorithm 



** 

6.74 

** 
** 

1.85 
23.83 
76.37 
476.11 



*rhe reader should note that the 1108 is approximately three times as fast 
as the PDP-10. 



The entries in Table V that contain asterisks (**) Indicate that the memory 
allocation of the PDP-lO at M.I.T. has to be increased to do some of the more 
difficult polynomials given. This was not done, for obvious reasons, so no 
factorization times are available for Wang's algorithm. POLYFACT uses 53K 
(K*]i02»> words of memory on the UNIVAC 1108 for factoring most polynomials. 
This 53K words includes 28K words for the storage of approximately 230 sub- 
routlres and functions that comprise POLYFACT. The actual working space in 
POLYFACT is 25K words. Berlekamp's algorithm implemented by Wang has about 
40K words (36 bits/word) available for working space. 

One of the problems encountered by Wang's implementation is that large 
amounts of storage are required in factoring the more difficult polynomials 
(those wl<:h high degree and large numbers of terms). The part of POLYFACT 
that necessitates the largest use of memory is the M x N possibility list and 
the possibility search tree. The size of the M x N list is primarily a function 
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of the number of variables and the degree of the terms (more specifically the 
size of the M x N list is a function of the concentration of the variables in 
Che terms and the degree of the variables). The size of the possibility 
search tree is dependent on the value of M and how well POLYFACT learns to 
select terms and possibilities* 

Computing Costs 

We have tried to develop a formulation of the computing costs for this 
factorization technique* However^ the heuristic nature of the technique 
involving learning has prohibited us from formulating costs. All of the 
factors that dominate computing costs , e*g* M and the number of possibilities 
in the term are unknown until after factorization. The analysis of 
variance experiment is our best attempt to isolate the factors that tend to 
control the cost of factorization. 

The encouraging result from the analysis of variance results Is that the 
degree of the polynomial does not strongly influence performance as It does In 
Berlekamp^type algorithms* The analysis of variance tables (tables VI and VII) 
show that the factorization time is Influenced somewhat by the nundber of possibilities 
In term Tp and the number of possibilities in a term is influenced primarily by 
the number of variables in the term* Thus» our technique works particularly 
wellp with respect to computing costs p for multlvarlable polynomials having at 
leaat one single variable term* 

^^^^^^^ H^^ of Thla Factorization Scheme 

The author sees the usefulness of this factorization scheme in four areas* 
Firstf even though this technique Is combinatorial in nature p it could in some 
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cases, obtain a solution more quickly than Hensel's approach. Polynomial 5 
in Appendix A is an example of a situation where Hensel's Lemma would blow up 
a great deal* Wang^s algorithm depends on substituting 0» 1| or -1 for all 
but one of the variables and then fectoring the resulting univariate polynomial. 
Wang says that it is desirable to substitute as many zeros as possible because 
nonzero substitutions can cause some intermediate expression growth. Substitution 
of zeros for all but one variable can lead to the "bad zero" case mentioned earlier. 
Secondly, this technique could be combined with the Berlekamp-Hensel algorithm 
to handle some of the polynomials that cause problems for it (the author is 
currently working on a paper discussing this idea). 

Thirdly, the idea presented through this technique deviates sharply from 
the current approaches to polynomial factorization by incorporating learning 
in it. Learning allows the algorithm to adjust to the sequence of polynomials 
factored with the result that factorization is performed more efficiently. 
We feel that new approaches to factorization should be presented, hopefully 
with the prospect that some useful ideas can be extracted. Finally, the 
scheme implemented in POLYFACT performs quite well despite the relatively 
inefficient implementation. We feel that the technique merits consideration; 
but we still consider the Berlekamp algorithms to be the most general 
factorization algorithms available. 

Analysis of Variance Experiment 

The performance of the mathematically oriented factoring algorithms, 
«^ Ku8ser*s [19] and Berlekamp *8 [2] become leas efficient aa the degree of 
the polynomial increases. The effect of the number of variables and the size of 
Che factors on the factorization times of these algorithms has not been published. 



In order to determine vh:it l ac.tu! : : ri ueuct* tiic, t actor i zation times 
for our scher.c, wo c.imi''uU:v in f .:t^:^^ r o .>rir; i st 1 n.: of a factorial analy-- 

sis of variance [1], Tlie maivsis of variance separates the variations 
among all the observjitions into two pari.>;, eacti part measuring variability 
attributable to soidc spec i \ i c source . The level of is ignif icance is con- 
sidered to he 10 per com. 

The I actors considered in Table VI a; e: 

1, M - the size of the M-term factor^ 

2, .WARS - the number of variables in the polynomial, and 

3, liPOSS - the number of possibilities in the ter.n T. 
The factors in Table VIl are: 

!• :i - the size of tlie M-term factor, 

2, N - the sizt^ oi the N-term factor, 

3, NV - the number of variables in tht: term T, and 
U. DEG - the degree of the term T. 

Some of the important observations from the analysis of variance experi- 
ment are: 

1. The factorization time is quite dependent on tl\e value of since 
F 90(1,4)=A.54. 

2. The factorization time is somewiiat dependent on the number of 
possibilities in the term T, since F (jqC2 ,4) =4 . 32 • 

3. The number oi possibilities in T depends most heavily on the 
number of variables in T, followed by the def^ree of since 
F gQ(l,2)=8.53 aid F ny(2,2)=9.0. 

A. The degree of lU^^ polynomial is a»n. of major importance in deter- 
mining the factorization time, 

5. The effect »r the number of variables in the polynomial on the 
factorization time is almost negligible. 



43 



TABLE VI 

ANALYSIS OF VARIANCE 
(FACTORIZATION TIMK IS THK DEPHNLENT VARIABLE) 



BEST COPY AVAIiABLE 



Source 



Degrees of 
Freedom 



S Limri o f 
Squares 



Mean • 
Squares 



M 

NVARS 

NPOSS 

M X NVARS 

M X NPOSS 

NVARS X NPOSS 

RESIDUAL 

TOTAL 



1 


142»7a2.b2 


142,702.62 


6.53* 


2 


2,553.06 


1,276.06 


0.05 


2 


158,432.96 


79,216.48 


3.62 


2 


63.80 


31.90 


0.002 


2 


142,934.83 


71,467.41 


3.27 


4 


83,081.77 


20,770.44 


0.95 


4 


87,423.08 


21,855.77 




17 


617,192.12 







*Signif leant at the 0.10 level in this and all following tables. 

The reason that the number of variables in the polynomial and the 
degree of the polynomial are usually not heavy contributors to the factori- 
zation time is that this factorization scheme tries to. select a term to 
initiate factorization that has a minimum number of variables in it and 
is of minimum degree. This tends to decrease the importance of these two 
factors. 

We note from the analysis of variance experiment that the factoriza- 
tion time increases with the size of the M-term factor. This increase in 
factorization time is due partly to the fact that the larger the value of M. 
the more conblnations of possibilities that can exist. However, this is not 
the only contributor to the value of M influencing the factorization time. 
The primary purpose of the initial implementation of this scheme in POLYFACT 
WM to study learning in a complex problem environment and not necessarily 
to produce an efficient implementation. The importance of the size of M 
G«n be reduced considerably in POLYFACT by improving the technique for 
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TABLE VII 

ANALYSIS OF VARIANCE 
(NUMBER OF POSSIBILITIES IN T IS THE DEPENDENT VARIABLE) 

BEST copy AVAiUmt 





Source 


Degrees of 
Freedom 


Sums of 
Squares 


Mean 
Squares 


F 



M 


1 


425.0^ 


425.04 


2.15 


N 


1 


0.38 


0.38 


0.002 


NV 


1 


1,926.04 


1.926.04 


9.68* 


DEG 


2 


3,077.08 


1,538.54 


7.74 


M X N 


1 


477.04 


477.04 


2.40 


M X NV 


1 


165.38 


165.38 


0.83 


M X DEG 


2 


326.58 


163.29 


0.82 


N X NV 


1 


715.04 


715.04 


3.60 


N X DEG 


2 


704.25 


352.13 


1.77 


NV X DEG 


2 


430.08 


215.04 


1.08 


M X N X NV 


1 


3.37 


3.37 


0.017 


M X N X DEG 


2 


165.08 


82.54 


0.42 


M X NV X DEG 


2 


150.25 


75.13 


0.38 


N X NV X DEG 


2 


847.58 


423.79 


2.13 


RESIDUAL 


2 


397.75 


198.88 




TOTAL 


23 


9,810.96 







searching the possibility search tree, and by providing a more efficient 
division algorithm. The division process in POLYFACT is a heuristic on. 
and is not the usual polynomial division algorithms [7], [12]. 



Other Implementation Considerations and Possible Modifications 

We feel that this factorization scheme can be made more efflr.if^nt and 
perhaps more operable than the Implementation In POLYFACT. We are currently 
Investigating the possibility of Incorporating s^n* of the ideas in the Berlekamp-* 
Hensel algorithm in this factorization scheme* Also the coefficient bounds 
formulation [27] can be used reduce the number of possibilities available in 
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the and sets* The replacement of the heuristic division algorithm by 
another polynomial division algorithm will improve the efficiency of operation 
considerably* By not requiring an explicit value for the number of combinations 
of M and N determined by the model-^bullder is greatly reduced^ l.e* only 
the value of M will be specified. 

The factorization scheme requires the value of N to form the M x N 
possibility list; however^ in some Instances (when terms have been combined) 
specifying N depends on predicting the number of terms in the polynomial 
prior to simplification* This places an unnecessary constraint on the model- 
builder. We propose the following as a possible alternative: 

1* Perform factorization as described in this paper when the poly- 
nomial is considered unslmplif lable . This allows N to be expli* 
cltly defined^ and the M x N possibility list co be constructed 
as outlined in Section IV. 

2« When a polynomial is considered simplified then: 

a. Determine M and create the M x N possibility list by using 
N-K*max(M,[NTERMS/Ml), where l.^K<I and I is chosen by the 
implementer and [ ] is the greatest integer function. 

b. Proceed with the factorization attempt as before; but use 
another more efficient division algorithm than the heuristic 
one mentioned abovw . 

c« If the attempt Is unsuccessful, modify M and repeat the process. 

We suggest that the initial value of K for a factorization attempt (with a 

fixed value of M) be greater than one. Then if factorization is unsuccessful^ 

reduce K to one and try again. The reason for choosing an initial value of K 

greater than one is that the size of the possibility list decreases as N 

increases » and the possibilities for construction of the M-term factor might 

be in the smaller list. This could result in a saving of time and memory. 
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VI. SUMMARY 

POLYFACT demonstrates that learning can be used to Improve significantly 
tha efficiency of a coinplex program in attempting to solve a difficult problem 
the factorization of multivariable polynomials. The term selection tests show 
that POLYFACT selects a term with the minimum number of possibilities In 
approximately 73 percent of the polynomials factored. The possibility tests 
demonstrate that in most cases POLYFACT need consider only 20 to SO percent 
of the possibilities in the actual search space, 

Previoua attempts at determining the symbolic factorization of multivariable 
polynomials using a purely heuristic approach have indicated very little success. 
The factorization tests described in this paper demonstrate that POLYFACT can 
factor many nontrivial polynomials. The degree of the polynomial and the 
number of variables in the polynomial influence the factorization times very 
little 9 as compared to the Berlekamp algorithms. The size of the M-^term factor 
proves to influence the factorization times most. Surprisingly POLYFACT 
competes with Wang's implementation of Berlekamp *s algorithm with respect to 
memory usage. 

This heuristic factorization scheme appears to work quite well on polynomials 
that cause problems for Wang*s algorithm, e,g, high degree polynomials, "bad 
zero" polynomials, etc. We feel that some of the ideas presented in this paper 
can be used to Improve the performance of the more general Berlekamp algorithms, 
especially In the reconstruction of multivariable factors from the univariate 
factorization of the original polynomial. Also, some of the Ideas In the 
Berlekamp algorithms can be used to definitely i^rove the performance of this 
technique Implemented in POLYFACT, 
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AFPENDU A 

POLYNOMIALS ^ ^ AVMIABIE 

All of these polynomials were factored by POLYFACT as part of the research 
dMcribed in this paper. 

1. (8x-5y) (xy-8xz2+i2_5y22) 

2. (5x*+3x5-6z*)(7xz3+Ax2y2-9y3z) 

3. (yz-htz^-x^^X-y^zZ+^y+x^z) 

4. (x3y2) (l+xy2z*+x2y2,4) (j2+3j2y5j24^2,5+,5+x2y23+xy2z*-he2y3js5435yjA+,^3y) 

5. (-yl0zl4+xl7y4+x9zl8) (x9y3zw4+x6vAz84v7v5) 

6. (5x2y3-6x5r^2xyz) (z V-xy222-x3yw2-x5yM) (-z6w*-x*y2+y2z3-x3yw3-x2y2z2w2+x52) 

7. (z V-xy2z2-x3yw2-x5y6w*) (-xM-xS^^z^-X'^yw3-x2y222w2+x52) 

8. (Ay2w2+7x2y2zw2+6x3y+6x3z^rf2)(4^4x2z2vf4y3jvf3x2y2w2+x2yw2+6y2) 

9. (x2y3-x5z3+y2) (j3^4.xy2z2-x3yw2-x5yM) (-z^^-xS^+y^z^-xV^-xV* V-hc^z) 

10. (z-hH-x-3)^ 

11. (z) (3xyzw-26y3x2-8xyzw2+14x2z) (-6x^y'^z V+27x2y3z3w3-47xyzw-3Ax2y2w2+5xy2 
+47xw3+6xyz2w-39x2y2z2w3-21x3y322„2+33c3y„3+i9x3y22„3_37y222^26xyz2+26x3y3z 
-47x2y2z2w2-47x2yw2 ) 

12. («+y+x-3)3(z+y+x-2)2 

* 

13. (x-y-z+v) (x-y+z-w) 

14. (x2y) (Ily2-22x*+33x5y2+35x3y) (22y5+37x^-18x*y5-38x2y*+29x2y3-4lxS2-26x3y^) 

15. (70wvri-x2yw+fc2xyzu2) (97xv+45xy2zu2-14z2w2-56y2wu+96xy22wu-86xz2w+2xy2w2u+81xz) 

16. (29xl2yl2,V+3y20wl5+2lx3z2.15y2z")(x2Uyl4_,31^24yl84^2y2^12jj20) 

17 . (z-r-x2y+w-xy2) (-i-xfy-z^w-z+zw^+w) 

2 2 7 9 

19. (x-y-z4v) (x -2xy-»-y -xz'fyz-fxw-yw+z''-2zw+w'*) 

20. (x2z2-y3)(x-y+z) 

21. (x2y) (3y V5x^-3x^y^-6x2y^) (y^-Sx^Sx^^+Sx^y) 
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22. (xV)(Ay2-2xy"+3x^) (->»-7y2-x2y) 

23. (x) (2x-4y3-5y*-3x V) (-6-3xy-4x^y3+3xy^) 

24. (xy2) (4x-xy*-y^-»-xy3) (6+4xS^+y-2x^) 

25. (x^y^ (5y+3x5-Ht5y)(y^+4xV+x*) 

26. (x) (4x2-y5+7x2y3+7xy2) (33ri-7xy^-6y^-6x^y5) 

27 . (6xy2) (ex^-x^y^-Sy^zS) (x^-x^+y^z^) 

28. (yx^) (222+5xy V+6x^y5z V) (-7-2xy*zw^+y^zw^+7x2y^z^w^-3xS^z V) 

29. ( x^y)(6x2+7xy-3y^-4xy^)(-3x^-x^+4xV2y^-xV) 

30. (xy) (23cf 5y^-2xV)( 6x^-6xy3-7y^+3x3y^-x^y3) 

31. (y) (5y3+3y^-2x^) (-3y2+7x^y*-4x3y5-7x^) 

32. <2y2z3) (2z2-3x5y2-3xVz^) (3z^+3xy*-5x2y5z2) 

33. (2x^y V) (42^+3y3z^w+y2z-6x2y3w) (2xz+2x2w2+2x^z V+z^w) 

34. (2xSz^) (3x2+3y3z5+x2y323-2z2) (.'xy-7x3z2+4y^+3x2y3z3) 

35. (xVz) (7x-2x2yz3+2y^z3) (-6xz3-7y^z-6xy^z^+x2y5z3-6x3y3) 

36. (xVzw)(7zV-3x3yV+3xy6zV+7xVz)(2-2xS-*z2-x5y^^5xy3z3) 

37. (xS^z^) (3x2+3yz-4x5y2z2-5x2z3) (-3x2-4y^+6x2z5-5xVz'*-5x3y6z3) 

38. (x^y^z^) (4y+7xy3z5+x^-Sx^y^z^) (-3y^-3xVz^-'x^2^) 

39. (x^yz) (x^-2y^z2+2x^z) (3»f3yz^+6x2y^25+x^y^z*) 

40. (xVz) (62^-7y^22-2y^) (7x2z2+3xV^+7y223-2xy2z^-7x3z) 

41. (xz) (z^-ex^yz^-Sxy^) (-7x*-5x2y2z^-4x^22+7y V+4x5z5) 

42. (y) (2xfx^y^z^-y) (-3z^-y^z^-xV-7xy2) 

43. (t»fx*y^«*-y-*x^y^) <6y^-6x2y^+3xV4y^-6x6y^) 

44. (xy^z) (2x^+5xy^z3-Ax3yz^+7y^z^) (3xz5-5xVz^+y^z^-x^y^-4x^z6) 

45. (lly-22x2+33x2y2+35x)(-41+10xV22xy^-18x^y3+67x2y2-41xV-26xV-^5y^+3x^) 

46. (Xy)(47xy+4xy^u+z-*w3-13xyz3w2u3)(8xy^43x3y3z3u„23x3y2wu-20x2y2z2w2u2 

-46xwu^+45x^-48x"'y^zwu-9y-^vm+36xy^2wu2+5x^y^wu+36xyz^w3u^36yVu 
.29xy^z^w^+14x\^z^wV46x"*2V31yVu2-9y^u2) 

:Er|c 3^1 
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47. (x^yzvm^) (y^-32x^zw^u-^29yz^w3u-A4xw') (-26x^u^+48yz^wu-x^y^zw^u^) 

48. (y^) (21x-32x^2+7z) (19x+28x^y^H-9x^y-2x2y2+23x^yz-'+3222+19xz-*-X0x'^y-*2 
+19x2y2z2_8x2+22x^z^-lJx^z\28x2z^) 

49. (z) (14x^+3xyw-26y^z-8xyw^) (5xy^-6x\^z\-^+27x^y^z^w^-47xyzw-34x2y2w2 
+47xw^+6xyz^w-39x^y^zV-21x^y^zV+3xV^+19x\'^zw3-37y2z2w+26x^y^z 

-47x2y2zV-47x^yw^) 

50. (xy) (A5x-28x^-46y^) (-14+5xy^-34y*^-15x^) 

51. (zw^u) (42z2+46x-^y V7x^y^zw2u^) (15x^zV4y^zw^-37x^y^2 Vex^y^u 
+42xzwu'-2x ywu -6x2 u''+19x"'z-'w ) 

52 . (x\z) (31x^-22y^zw-23xyz^w^+40xyw"') (-24w^+25xz V-42xy'^wV28z\^-29xz^) 

53. (y^) (14zw+63x3zV-41x^yw+46x^yz) (33zvH-49x^y+9x'*2^^-26x^y22^w) 

54. (yz) (14y2-38zw^-41x2-46x^z V) (-29y+9x^z V28x^y'^z+43xz^w3+52x^2w^ 
•♦•4xyz^w^+7x2y^2V8xz^-33x2y^2w^+21y^zw2+15xyz2-37xy^2^-21x^yz3 
-40y'^+35xy^+8y^zV+20x^zw^) 

55. (x) (6y^w-14xy3zw2_34xz3+27y^z V) (-43y^+20x^y^2+262^w^+44xV+18xw2 

+17x^y3z^w^) 

56. (yz) (44x^z^-41x"^z^-26yz^+24y V) (-12x^2- 38xzwf34x^yzw2-yV-6xy2w3) 

57. (xy^z*^) (19xy^w2+37x"*yz3u^-x^2^w^u^-16y^zw^) (33u^-27x2zw-^-16x2y2w^ 
■♦•13yw2u3+i6x^yVu2) 

58. (x^z^u) (8x-43y^zw-43yzw^u) (-8x^w^u^-16x^y2^u+49x''yz^wu2+12z-*w^ 

-5x yzw u''-40xyzw u) 

59. (29z2+27y^z-'-23x^y^-49x)(-22xy+28x^yz-38xVz"*-A3xVl8x^z2-78xy3z2 

+35y^2V44yz^-»7^z^+20xy^r--42x^yz^-31x^y^+2y^+25y^z-5yz-46x^y^z) 

60. (y^z) (39yw-49xz+25x^2w^) (37yzw-48x-^2w'^+49x^yV92 V-10x^y^2+43xy"'z2w' 

9 1 2 2 

+41 "^zw -33x y zw) 

0 2223 23 333 32 

61. (xz)(31yz +20xyw-44x y 2 w -39x2 w ) (-44yw-9x2 w +30z w-37x y w 

'y ^ 23 32 22 33 

-3x^yz w +21y z w-20xy2 w -7yz w -24x y ) 
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62. iyz) (llxwf39x\^2W-3x^2+yz^w3)(-19w^-A2xy V-38xyw-47y2w^+2y^zw 
-46x^y28w-27x^yVf46y^2^w^-14x^y3z) 

63. (rV-rv^-t5) (z V-xy2z2.xV^-x^^^) (-z V-x^S^^^-x 

64. (24yz+68xz^-72xV) (-x^^z^Vx^ V+x'z^®) 

65. (24yz+68xz^-72xV) (-y^z^-Hcy+x^z) 

66. (x) (47y+4y^u+z^w^-13xyz^wu^) (45x^+43x^y^z2u-23x^ywfl6xy^zwu-46xu2 

-48x^ywu+27y'^wu+5x'^y2wf36xyz^w2u-29y2zw2+14x2y2zw^+46x^y^uf8xy 
+31yw2u2-9y2u2) 

67. (xz^u^) (ISz^uflOxy W+18x22w3u2+6y"*z^w2) 12y^z2+48x^y^z V 

+2x2y2wu2-:iSyz^*wV-32y^zVu2-4xw2+8x3z^wu-llxV2u-44xy^z^wu) 

68. (6xy+40x^w+31x2u^+35y^w2) (24xy+9x^wu^+44z2w^u+37xzw2+xy2z2w2u2 

+29yV+31yz2w2+24x2y22u2+37y22u2+23xy2+13x2y2w^u+21xyzwu^+12x2yzw 

+8z Vu2+22xy2+22w2u2+12xy^z2u2+43xyz^wf43x2yu+39xzwtf' 7zw2u'^ 
+24xy^z2wu2+27x^uw^ir»-41y'^z+42y^w^u2) 

69. (xy) (47xy+4xy^u-y-z V-lSxyz^w^u"*) (45x"'+43x'^y^z^u-23x\2^_20x Vz2w^u2 

-46xwu^-48x\^zwu-9y^wu+36xy'*zwu^+5x2y3wu+36xyz''w\2+36y3^2y_29xy-'z2w'' 
+14x\^z2w"'+46it\2„+8jjy2_j.^j^y2^,3^2_gy2^2j 

70. («+y+x-3)"* 

71. <47xy+zV-w^)(45x^+3z^-y^-9y^+2wz) 

72. (35xV33x^y^+lly2-22x^)(22yV37x^-18x\5-38xV+29x^y3-41xS^-26xV) 

73. (x^y3z2) (293ef3xy^+z V-X2xvz\^-w2) (18x V3z^-y^+X4y^w^-8xy^+2wz) 
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